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The  objectives  of  this  project  were  to  develop  new  methods 
for  analyzing  memory-based  techniques  in  machine  learning  and 
general  inference  problems.  The  project  successfully  developed 
new  mathematical  results  explaining  when  memory-based  methods  are 
useful.  Several  applications  were  developed  and  studied  in  this 
project.  A  system  for  building  transpoijtable  agents  was  developed 
and  several  Information  processing  systems  have  been  based  on  it. 

Technology  has  been  successfully  transitioned  to  both  DOD  and 
commercial  entities. 
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Objectives 

The  research  objectives  of  this  project  have  been  to  study  the  theoretical  and  algorithmic  underpinnings 
of  memory-based  learning  and  inference  and  then  to  explore  uses  of  the  methodology  in  timely  and 
important  applications.  The  use  of  memory-based  methods  has  been  growing  in  many  application  areas 
because  of  two  reasons:  1.  large  fast  computer  storage  has  become  ipore  affordable  and;  2.  parametric 
modeling  techniques  are  often  difficult  to  train  and  use  on  problems  with  large  data  sets.  The  initial 
focus  of  the  effort  was  to  discover  the  mathematical  foundations  for  memory-based  methods  and  to 
develop  algorithms  that  would  allow  efficient  use  of  large  memories  for  pattern  analysis  and 
recognition.  The  application  area  that  received  the  most  attention  in  this  project  has  been  networked 
information  processing  using  transportable  agent  systemsi 

Accomplishments 

Research  supported  by  this  grant  has  resulted  in  advances  in  the  theoretical  aspects  of  memory-based 
learning.  One  of  the  original  goals  was  to  identify  pattern  analysis  problems  which  could  be  solved  by 
memory-based  as  opposed  to  parametric  methods.  Existing  work  on  high-dimensional  memory  based 
methods  has  been  relatively  pessimistic  about  their  utility  in  spite  of  experiments  which  showed  that 
they  worked  well  on  real  problems.  In  our  work,  we  have  shown  that  the  concentration  of  data  plays  an 
important  role  in  high  dimensional  real-world  pattern  recognition  applications  and  measures  of 
concentration  provide  metrics  for  how  well  memory-based  methods  work. 

In  the  application  of  these  basic  results  to  distributed  information  management,  the  project  has 
developed  a  large  number  of  software  systems  for  supporting  text  retrieval  and  transportable  information 
agents.  The  agent  system  is  based  on  the  Tool  Control  Language,  now  an  open  system  actively 
supported  by  SUN  Microsystems.  Called  Agent  Tcl,  it  has  been  downloaded  by  several  hundred  users  at 
this  time. 

Agent  Tcl  is  a  transportable  agent  system  with  comprehensive  functionality.  It  has  been  used  in  a  variety 


of  applications  including  CAD  mechanical  parts  searching,  medical  records  retrieval,  and  tactical  picture 
information  processing.  This  last  application  has  been  developed  by  Lockheed  Martin  for  the  US  Army. 
Their  system  has  been  demonstrated  at  Fort  Bragg  and  other  Army  facilities. 

The  Lockheed  Martin  effort  is  using  Agent  Tcl  to  develop  information  agents  that  can  assist  Army 
decision-makers  in  low  bandwidth  battlefield  situations.  Their  information  agents  move  within  a 
computer  network  that  is  vulnernable  to  changes  in  its  nodes  and  connectivity  retrieving  data  from 
remote  sources,  processing  it  and  presenting  summaries  to  battlefield  commanders.  Other  serious 
defense  and  commercial  users  of  the  Agent  Tcl  system  include: 

•  Mitre  Corporation 

•  Network  Operations  Technologies  Lab,  NYNEX  Science  and  Technology 

•  Siemens  Corporate  Research,  Germany 

•  Telecom  Bretagne,  Network  &  Multimedia  Dep.  (RSM) 

•  AT&T  Research. 

The  project  has  made  several  advances  in  memory-based  methods  and  transportable  information  agent 
systems.  Specific  accomplishments  have  been: 

•  An  analysis  of  conditions  under  which  memory-based  methods  are  effective  for  solving  machine 
learning  and  associative  memory  processing  problems. 
http://www.dartmouth.edu/~gvc/prague-ieee.ps 

•  New  results  on  on-line  reinforcement  learning  using  Q-leaming  to  show  that  simultaneous  learning 
and  optimality  are  possible,  http://www.dartmouth.edu/~gvc/oxford.ps 

•  A  fully  mobile  agent  programming  system  built  on  top  of  the  Tool  Control  language  (Tcl),  called 
Agent  Tcl.  http://www.cs.dartmouth.edu/~agent/papers/chapter.ps.2s  an  overview  and 
http://www.cs.dartmouth.edu/~agentis  the  comprehensive  Web  site. 

•  Analytic  results  relating  agent  performance  with  the  architecture  of  the  decision  structure  used. 
This  appears  to  be  the  first  attemp  to  model  and  study  the  relationship  between  automated 
distributed  decision-making  architectures  and  problem  solution  accuracy. 

http  ://www.  dartmouth.edu/ ~gvc/uncertainty  .ps 

•  Demonstrations  of  the  Agent  Tcl  technology  to  diverse  application  domains  has  been  extremely 
successful,  suggesting  that  the  concept  is  robust  and  highly  adaptable.  See 
http://www.cs.dartmouth.edu/~agentAnd  http://comp-engg-www.dartmouth.edu/~3d/paper.ps 

Other  Transitions 

Basic  research  on  this  project  has  led  to  a  World  Wide  Web  application  called  the  Informant 
(http://informant.dartmouth.edu)  which  has  received  numerous  positive  reviews  in  the  popular  literature 
as  well  as  licensing  requests  from  third  parties.  There  are  now  over  13,000  registered  users  of  this 
application  world  wide.  Users  include  DOD  personnel  and  agencies  as  well  as  other  government  users. 

A  license  arrangement  with  the  National  Air  Intelligence  Center  (NAIC)  is  currently  being  discussed. 

Several  commercial  software  companies  have  approached  the  project  regarding  licensing  and  other 
commercialization  plans  for  the  Agent  Tcl  but  they  are  in  early  stages  of  discussion. 
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